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1. INTRODUCTION 

Cloud computing is characterized as a type of distributed and parallel system that consists of a series 
of dynamically supplied interlinked and virtualized computers which are provided by the service provider as 
several centralized computing resources with adequate service level agreements [1]. Cloud computing 
provides environments for managing resources concerning flexible infrastructure, middleware, application 
development frameworks and business applications. Cloud services are operated as pay-as-go or free vendor 
services. Software-as-a-service (SaaS), platform-as-a-service (PaaS), and infrastructure-as-a-service (IaaS) 
are the primary categories of cloud offerings. There are four cloud architecture models, in addition to the 
cloud services, which are private, public, community, and hybrid clouds which are used to supply a variety of 
services that enhances operations in data centres, internet of things, edge and fog computing [2]. 

The cloud middleware and services at all layers (XaaS) enhance operations on the cloud by 
connecting computers and devices to either cloud mobile or web applications which is also relevant to 
performance analysis of such aplications [3], [4]. In the traditional computing environment, the entire stack 
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which consists of applications, data, runtime, middleware, operating system, virtualization, servers, storage 
and networking all reside in the data centre under the control of the organisation. Conversely, this entire stack 
is now supplied via a cloud service provider (CSP) under SaaS. The middleware is under the control of the 
user in PaaS, but managed by the CSP under IaaS. Various CSPs like Microsoft, Google, IBM and others 
have highly robust middleware and other microservices made available to user. Express is a server-side web 
framework for Node.js which helps to create APIs very quickly and easily by using hypertext transfer 
protocol. Express has built-in middleware functions, but middleware also comes from third-party packages 
and custom packages. For example, the IBM middleware functions in Express have access to the request and 
response objects. 

CloudSim offers the ability to seamlessly model, simulate and experiment with evolving cloud 
computing infrastructure and application services, with a modern widespread and extensible simulation 
framework [5]. This includes support of large-scale cloud computing network modeling and simulation, and 
an integrated framework for data center modeling, service providers, planning, and allocation policies. The 
CloudSim toolkit is used to model, simulate, and execute cloud-enhancing applications. It enables extension 
and policy specification of every component of the software stack as a completely personalizable device. It 
helps users to handle the complexity of the specification, delivery and design of resources in physical 
environments [6]. Cloud bus toolkit is a layered, seven module architecture at the top of the stack, utilizing 
Cloud instances for everyday applications that are used for various purposes [7]. 

Cloud resources are acquired via third-party brokering services that promote access to the 
infrastructure. The virtual voyager, architect, network, native and mobile mover. The virtual voyager 
comprises the SaaS, PaaS and IaaS stacks. A virtual voyager leverages technology to access virtual computer 
resources in addition to increased versatility. It takes advantage of better response time, thereby reducing 
costs [8]. An application delivery network (ADN) is an integrated infrastructure that includes communication 
tools, layer of service packets and network layer services for host applications [9]. However, the trend now is 
a software defined network (SDN). By proposing new design based on the separation of control and data 
planes, SDN enhances solution to protocol design problem and configuration errors on large-scale distributed 
systems. 

Cloud middleware is an interesting field of research and the choice of a research subject can be a 
difficult process. A systematic mapping evaluation presents an overview of the number of publications within 
a field of interest and categorization them by using a scheme that allows a description of the degree of 
publications to be published in various fields of study [10]. Here, a systematic mapping study is built by 
examining issues relating to cloud middleware, and services. Through this process, the number of 
publications and work in this area will be defined. This study was carried out by establishing three facets for 
the scheme, they include the contribution, topic, and research facets. The contribution facet considered 
method and model amongst others, while the research facet dealt with the kind of research carried out. The 
topic facet was completed by extracting key areas of cloud middleware, stacks, tools and services on the 
cloud. In this paper, section 2 examines related work. The materials and method applied in the study are 
provided in section 3. The results and discussion on the outcome of the mapping process are presented in 
section 4. Section 5 shows the conclusion and recommendation for further research. 


2. RELATED WORK 

Santos, et al. [11] conducted research on systematic mapping to enhance the utilization of computer 
science conceptual diagrams, and the outcome of this study aims at identifying and analyzing current work 
utilizing backward snowballing as well as manual processes using five digital libraries. Through analyzing 
properly, the research focused on the teaching and learning process of concept maps and the key goals were 
achieved. Digital archives and repositories were used for research in the field of study. 

Odun-Ayo et al. [2] is a systematic mapping research of edge computing and the internet of things 
with the cloud. A combination of topical, research and contribution facets were used to analyze publications 
on applications, concerning tool and model. They were closely followed by publications on architecture of 
edge computing. Opinion papers were the least published in the aspects of architecture. These were followed 
by publications on evaluation and solution research related to application. Most papers on ubiquitous 
networks were in the area of validation research. Furthermore, there was more work on optimization in the 
areas of philosophical, valuation and experience studies, with all following the procedures in [12]. SCOPUS, 
ScienceDirect, Compedex, ACM DL and IEEExplore were used for the work's search strings. 

Petersen et al. [13] examines the manner in which researchers perform the systematic mapping 
process and how recommendations are to be revised based on lessons derived from the systematic maps and 
the procedures for systematic literature review. Certainly, the authors performed a comprehensive mapping 
study on systematic maps, taking into account relevant patterns in systematic reviews. They found that 
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several recommendations have been used and merged in the vast number of studies carried out leading to a 
systematic mapping studies with more valuable conclusions. 

The authors in Brocke et al. [14] presented six major aspects for the effective planning and 
communication of design of research projects that are science-based. They also emphasized the importance 
of the review of literature during scientific investigation and in the ever-increasing sphere of information 
system. The authors addressed the challenges of literary research and offered suggestions on how to resolve 
these challenges. They also offered practical instructions and checklists to help scientists plan and coordinate 
their literature searches. 

The study in Odun-Ayo et al. [15] systematically documented cloud computing models and 
implementation patterns. Design, service deployment, implementation, configuration, data protection, 
security and usage models were considered by the categorization framework. A total of 131 fundamental 
examinations was utilized and the guide was drawn up based on the ideas of [13]. ScienceDirect, ACM 
digital library, Springer and IEEExplore provided results from different search strings of the exploration. 

The work in Odun-Ayo et al. [16] is a systematic mapping analysis of networking for cloud and data 
centre. In the work, only 119 articles of the 131 articles consulted gave a concise contribution, which in this 
context was broken down into five major areas which are processes and metrics, devices, models and 
approaches. The result indicated that out of the 119 articles, contributions based on process and model had 
the highest percentage of 38.66% and 26.05%. However, contributions based on methods, tools, and metrics 
were 19.33%, 10.08%, and 5.88% respectively. SCOPUS, ScienceDirect, Compedex, ACM DL and 
IEEExplore were utilized in the work's search strings. 

The paper in Mahamad et al. [17] designed a cloud-based people counter which could be used for 
the tracking and business marketing utilizing Raspberry Pi embedded systems, such that the received data is 
transmitted to the Thing Speak, IoT platform. Performance evaluation of the system was done in a real-life 
environment to ascertain its efficiency and capability to enhance business decisions. The basic stages of the 
work are; development of people counting algorithms, application of the developed algorithms into the 
hardware, and the integration of the acquired data onto Thing Speak. 

The study in Reshma and Chetanaprakash [18] performed a study of developments in the 
automotive infotainment system with vehicular cloud network for enhancement and protection of in-car 
systems for smart and advanced entertainment operations. It is the vehicle ad-hoc network and support of the 
cloud system that relies on the transmission of this infotainment service. This work offers a summary of the 
research being done to exploit the infotainment system to get a genuine representation of input device power, 
weakness and open-end problems. The research contribution was summarized into the infotainment system 
over vehicular, schema-based approach, security-based approach, and traffic-based scheme. 

The research in Kumar and Shantala [19] is a broad research overview on data integrity and 
deduplication against privacy in cloud storage because of the frailty of cloud data, which demands improved 
security. Consequently, this work discussed the express research commitment towards the Integrity of 
records, privacy, and deduplication of information. This also helps to highlight new open research issues and 
to explore the possible direction in which the existing challenges can be addressed. Unrealistic assumptions, 
non-applicability towards external intruders, unconsidered computational costs, according to the work 
outlined open issues in this field. 

The study in Farahzadi et al. [20] performed a cloud of things middleware survey. To offer IoT 
services, the cloud is pivotal to giving intelligent conditions in houses, structures, and towns. There are, 
however, problems such as handling, aggregating, and preserving the big data involved. Cloud computing has 
enabled IoT as a web of things (WoT), providing almost limitless web services to expand broad-based IoT 
platforms. Middleware is capable of improving the heterogeneity of objects leading to efficient 
communication between interfaces, operating systems, and architectures. The research study analyzed CoT 
middleware technologies; identified the key characteristics of middleware for exploring various architectural 
styles and service areas. Also, to recognize middleware relevant to CoT-based stages and, to provide a 
rundown of current difficulties and issues in the improvement of CoT-based middleware. 

The research in Endol et al. [21] systematically examined high cloud availability and research 
challenges. Before reaching cloud service that is compliant with service level agreements, many challenges 
must be overcome. The work covers checks, load balancing, and redundancies for the enhanced quality of 
cloud service while adding several research problems in this field without neglecting network and 
middleware solutions. To identify methods that cover high-availability clouds, it adapted the systematic 
analysis suggested by [22]. The work involved requirement for assessment, research and search queries, 
research resources, inclusion criteria and exclusion criteria, the procedure of information extraction 
identifying primary studies, assessing the quality of studies and extracting relevant information and 
presenting an overview of studies. 
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The study in Birje et al. [23] is a cloud study focused on cloud computing ideas, technology, 
challenges, and health. This paper investigates the model of cloud computing in the area of domain, 
principles, technology, instruments, and diverse challenges. A systematic literary review of 77 selected 
papers, released between 2000 and 2015, was performed to explain correctly the complexities of the cloud 
computing model. Hence security was identified as the greatest problem, the topic is discussed in depth 
separately. The concepts discussed are interoperability, resource planning, protection, data leakage, resource 
sharing, load balancing, multi-tenancy virtualization, and service level agreement (SLA). 

The research in Chiregi and Navimipour [24] is the investigation of the cloud trust assessment and 
top-notch techniques utilized in cloud. Also, certain processes have been evaluated in terms of credibility, 
safety, efficiency, efficiency, protection, complexity, and scalability. There were 224 papers listed, that were 
screened to 28 based on the selection process. The survey would enable scholars, researchers, and experts to 
understand the developments in trust assessment processes in cloud environments through the presentation of 
up-to-date knowledge and problem issues. The strategy for selecting the article involves an automated, 
keyword-based search. The online repositories reviewed for this work are ScienceDirect, Google Scholar, 
Springerlink, IEEExplore, Elsevier, Wiley, Springer, and Emerald. 

The work in Muhasin et al. [25] reviewed the issues of security and privacy affecting critical cloud 
data and identified solutions to tackle challenges such as user access management, sensitive data protection 
privacy, user identity anonymity, and data file protection. To explore the fundamental targets of the proposed 
system, a pilot study utilizing an organized survey was led by specialists working in cloud security. This also 
provides a multi-level structure to enhance the management of cloud-based information systems. It is a 
systematic analysis of literature carried out in compliance with Kitchenham's guidelines [13]. The systematic 
literature review starts with the review, investigation discovers, data gathering and information assessment. 
The paper made inquiries regarding the effects of critical data management in cloud computing. From the 
related work discussed so far, it is obvious that no work has been done in this area of study, hence our work 
is novel. This is a new system that is being proposed, hence it is novel. From the author’s perspective, there 
are no similar papers in this field of study. However, there are several related works on systematic mapping 
studies which have been discussed in this paper which apply similar methodology in arriving at their results. 


3. MATERIALS AND METHOD 

This study focuses on developing a systematic map of cloud computing middleware, stacks, tools, 
delivery network and services at all layers. It was carried out in [11], [26], based on the formal guidelines for 
systematic mapping studies. A systematic mapping study is a repeatable method in which resources for 
research purposes are collected and interpreted. For a proper systematic mapping study as defined in Figure 1 
there are several required steps. Research questions have to be defined, which focuses on the scope of review 
to be conducted. All articles in the specific study area under examination are also checked. The papers are 
screened after the search to decide which paper is acceptable for the research. By examining the abstracts in 
the respective papers, a scheme for classification is designed with keywording. The data extraction process 
led to the creation of a systematic map. The above steps were involved in creating a comprehensive map of 


middleware, stacks, software, supply networks and resources at all levels of the cloud. 
Definition of Conduct Research Screening of Keywording Data Extraction and 
Research Questions Papers Using Abstracts Mapping Process 
Systematic Map 
Abstracts 


Review Scope All Papers Relevant papers Classification 
Scheme 


Figure 1. The systematic mapping process [13] 


























3.1. Definition of research questions 

Systematic maps give a review of the amount and class of work that has been completed in a 
specific research domain. This allows the visualization of patterns over time by illustrating the rates of 
publications. The places in which the work was published in the study may also be important sometimes. It 
might likewise be fundamental sometimes to have a good knowledge of the areas in which publications have 
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been done. These relevant issues decide the proper research question to be used in the study. The questions 

that govern the research are enumerated below: 

— RQ 1: What aspect in cloud computing middleware, stacks, and services are examined as well as what 
number of papers encompass the different areas? 

— RQ2: What kinds of articles and in particular what is the unique pattern of papers published in this field? 


3.2. Conduction of primary studies research 

Primary studies are typically accomplished by exploration of major digital libraries. That is achieved 
by looking online for conference papers and articles. Searches were done on different digital advanced 
libraries accessible on-line to acquire papers for this systematic mapping study. The search did not 
concentrate on book and printed material. Due to the high impact of conference as well as journal 
publications of those databases, four databases were utilized for the hunt. The searched digital libraries are 
shown in Table 1. 


Table 1. Electronic databases used for the systematic mapping study 


Electronic databases URL 

ACM http://dl.acm.org/ 

IEEE http://ieeexplore.ieee.org/xplore 
SCIENCE DIRECT http://www.sciencedirect.com/ 
SPRINGER http://www.springerlink.com/ 


The search query was structured to elicit outcomes with respect to information, population and 
comparisons. All aspects of the study focused on the keywords used in the search string. The queries used on 
the leading digital libraries for this cloud-based middleware research, include stacks, tools, delivery networks 
and services in each layer: 


(TITLE (Cloud middleware’) OR TITLE (cloud computing middleware’’) or (ALL(‘’cloud’’)AND 
ALL(middleware)))AND (TITLE (Stacks) OR TITLE (tools) OR TITLE (‘delivery networks’’) OR TITLE 
(XAAS) OR TITLE(‘’services at all layers’’)). 


For the search of the document metadata the above search string was used to ensure all relevant 
articles were obtained. All findings from the four digital repositories which relate to cloud computing and 
computer science were taken into account during the analysis. One hundred and twenty seven (127) papers 
were considered important to the inclusion from an initial list of 1,158 publications in the selected paper 
criteria, which were defined in the review emphasis and research question requirements. The research was 
carried out between 2001 and 2018. 


3.3. Inclusion and exclusion criteria paper screening 

Selection processes are used to ensure that the search and inclusion of all relevant research 
publications occurs. These processes were utilized to exclude irrelevant documents that pertains to the study, 
while papers pertaining to the study were included. This method also helps to exclude studies which have no 
direct answers to the research questions. Some abstracts related to the key issues without enough information 
and documents like these were also omitted. Furthermore, papers on tutorials, summaries, discussions, 
prefaces, editorials and presentation slides were excluded. The primary focal point of this study was 
considered important in inclusion of papers and also the secondary aspects were to a certain degree extracted 
too. Middleware, stack, platform, supply network and XaaS are the main focus of this report. Criteria for 
inclusion and exclusion therefore, are defined in Table 2. 


Table 2. Inclusion and exclusion criteria 
Inclusion criteria Exclusion criteria 
In the abstract, middleware, stacks, software, distribution This paper is beyond the field of cloud and computer science and 
networks and cloud services are addressed specifically. In does not assist with middleware, stacks, software, supply networks 
addition, the entire paper contributes to the study subject. and infrastructure on all levels. The papers are not cloud-related. 


3.4. Keywording of abstracts 

The classification scheme used for the study is accomplished through a systematic process. 
Keywording was necessary in reducing the time required in developing the classification scheme for this 
work. Furthermore, keywording enables the researcher to consider all relevant publications through the 
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classification scheme. The process involves the study of abstracts to identify concepts and keywords that 
relate to this study. After the extraction process keywords from numerous middleware-related articles were 
combined to provide comprehensive research insights. Afterwards, the categories for this study were 
established. However, in order for the analysis to be used with appropriate keywords it was often important 
to review the introduction, and conclusion of the publications. In conclusion, a keyword cluster was used for 
the evaluation of the various classes utilized in constructing the systematic map. Three aspects were utilized 
in this analysis of cloud middleware, stacks, networks and services. The first facets was based on the subject 
which was directly linked to the various aspects of the research. In the second facet, the types of 
contributions in the research paper were discussed in terms of the metric, model, instrument, system and 
procedure. The third facet comprised the research types undertaken. 


3.5. Categories and descriptions of facets on research types 
The third dimension dealt with the kind of work undertaken. A current classification of research 
approaches was explored [27]. The method includes the following definitions and categories. 
a. Validation of research: the techniques used in the papers reviewed are unique but not yet implemented 
for example conducting an experiment in the laboratory. 
b. Evaluation research: the techniques have been evaluated and implemented. Also the result of the 
findings discussed in the papers. 
c. Solution proposal: the process point towards a unique solution that was found to a challenge. The 
applications and benefits of such solution are also mentioned. 
d. Philosophical papers: these methods generate new ways to look at concepts and structures as problems. 
e. Opinion papers: there is no known form of research for the thesis under consideration here. It simply 
communicates the opinions of such researchers. 
f. | Experience papers: such papers refer to the author's personal experience and explain how things have 
been done. 
The classification scheme for this study considered the work in [27] suitable for use. These research 
types were used to examine the papers included for this study. 


3.6. Data extraction and mapping studies 

The included papers were analysed according to specific categories, based on the scheme of 
classification. The extraction of data from the specific documents used in the analysis was therefore possible. 
The classification scheme was determined by the data extraction method. New categories may be added 
during the process, while certain categories could be merged and some others may not be considered 
relevant. The data extraction process was conducted via a Spreadsheet table from Microsoft Excel. Each 
classification scheme category was included in the Excel tables. The publication frequency was achieved by 
combining the topic/contribution tables with the topic/research type tables. The frequencies from the findings 
on the Excel tables was the pre-requisite n creating the systematic map. It was important to assess which part 
of the research field was more prominent. In this way, the gaps in cloud middleware, stacks, and service were 
easily identified, allowing further work to be recommended in fields with low publications. 

From the result on the spreadsheet tables, the frequencies were presented via a bubble plot, at the 
intersection of the categories. The map comprising the plot was an x-y dispersion chat with bubble. The three 
facets used in the analysis gave rise to two quadrants. A visual map based on the contribution of the theme 
classifications to either the contribution/research classes was given by each quadrant. Furthermore, the 
bubble also provided descriptive statistics for easy comprehension. The map presented a simple overview of 
the analysis in the field of middleware, stacks, and services. 


4. RESULTS AND ANALYSIS 

The core motivation of the systematic mapping study on cloud computing middleware, stacks, and 
services was thematic analysis, classification and likely identification of the publication fora. Based on the 
analysis, research gaps were highlighted on the map, thus depicting which area of the field of study had 
shortage of publications. On the other hand, the study also indicated the areas that had more articles 
published. In this systematic mapping study, the primary studies were assessed via high-level classes, which 
were then used for producing the rates of occurrence of articles and also the map creation. 


4.1. Topic and contribution facet 

The classification scheme topics reflected the different aspects of cloud middleware and related 
resources. Hence the topics considered were stacks, tools, delivery network, services at all layers (XaaS), 
middleware and orthogonal. The tables in this study are the outcomes of the categorization of the primary 
studies. The primary studies were considered based on the topics used in the systematic process, hence the 
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data generated are displayed on the tables. The details of this dataset are too large to be included in the paper. 
The numerical results in the table simply provides the quantity of papers resulting from the classification 
scheme and data extraction process as shown in Figure 1. This is the standard way it is represented in 
literature. The listing of primary studies utilized for categorizing the topics viz-a-viz the contribution type is 
as displayed on Table 3, while the percentage of each category is depicted in Figure 2. In Table 3, suitable 
topics from the papers extracted during screening and keywording are examined to determine which ones 
discussed metric, tool, model method and process. Hence Table 3 contains the primary studies list used for 
the examination of the various topics against the types of contributions. Figure 3 shows the percentage of 
topics in the research category. The systematic map on cloud computing middleware, stacks, tools, delivery 
network and services at all layers is at Figure 4. On the x-axis of the left quadrant is the contribution facet. 
The category dealt with the type of contribution a paper offered the research in terms of metric, method, tool, 
process and model. In the study, metric had 10.34% out of the 116 papers in this facet. Tool had 28.45%, 
model had 27.59%, method had 18.10% and process had 15.52%. 

Furthermore, the left quadrant indicated that 1.72% of the model contribution were each on 
orthogonal, middleware, delivery network and stacks. Model contributed 2.59% to services at all layers, 
while the contribution to tool had the largest which was 18.1%. Also, Figure 2 displays the pie chart used for 
every topic within the contribution category. From the 116 papers within this category, 16.38% were based 
on stack, 51% were based on tools, 8.62% were topics on delivery network, 10.34% were topics on XaaS and 
12.06% were topics on middleware. 


Table 3. Primary studies for topic and contribution facets 
Contribution Facet 


Topit Metric Tool Model Method Process 
Stack 23, 24, 18, 25, 103, 111 7, 26 21, 27, 29, 59, 2,45, 116 
122 110, 120, 126 
Tools 4, 13,28, 31,33, 65, 66, 67, 34, 37, 38, 39, 40, 60, 32, 47, 56, 57, 6, 10, 16, 
102,105, 71,77, 82, 85, 86, 61, 62, 63, 75, 76, 79, 64, 74, 93, 72, 73, 90, 
125 89, 91, 99, 100, 80, 81, 82, 84, 104, 113, 119, 
113, 117, 112, 115, 124 123, 
Delivery Networks 15 22, 48, 14, 50, 42,43 51, 83, 127 
Services at all layers (XaaS) 1,55 19, 20, 69, 70, 118, 108, 87, 109, 98, 106 
Middleware 5, 12, 17, 78, 88, 9,11, 49, 68 30, 96 
92, 94, 107 
Percentage 10.34% 28.45% 27.59% 18.10% 15.52% 





Contribution Category 


Middleware 


Stack 
12% 


17% 


Delivery Network 
9% 





Figure 2. Percentage of topics in the contribution category 


4.2. Topic and research facet 

The listing of main studies utilized for categorization of the topics with respect to the research type 
is displayed on Table 4. Table 4 contains the primary studies data used for the examination of the various 
topics against the types of research. In Table 4, suitable topics from the papers extracted during screening and 
keywording are examined to determine which ones discussed evaluation, validation, solution, philosophical, 
experience and opinion research types. The x-axis of the right quadrant of Figure 4 contains the result of the 
type of research undertaken for this study. The x-axis of the right quadrant of Figure 4 is the research type 
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category. Evaluation research had 28.35% out of 127 articles reviewed. Solution research had 54.33%, 
philosophical had 5.15% and experience had 11.88%. No publications were present on validation and opinion 
research in field of study under review. Evaluation research had 28.35% out of the 127 publications included 
in this study. The breakdown of this 28.35% indicated that 0.79% dealt with orthogonal, 6.3% of the 
evaluation research was on tool and 3.94% was on stacks. From the 127 papers within this group, 15.75% 
were based on stack, 44.09% were on tools, 7.87% were based on delivery network, 9.45% were topics on 
XaaS and 22.83% were topics on middleware. 


Table 4. Primary studies for topic and research facets 
Research Facet 


Topic Evaluation Validation Solution Philosophical Experience Opinion 
Stack 23, 24, 103, 7, 8, 18, 25 26, 27, 29 45, 21 2,116 
111, 122 59, 110, 120, 126 
Tools 4,13, 28,31, 6, 10, 16, 34,37, 38, 39,40, 32, 93, 90, 113 
33,65, 66,67, 47, 56,57, 60, 61,62, 63, 
71,85, 86,89, 64,72, 73, 74,75, 76, 77,79, 
91,99, 100, 102, 80, 81,82, 84, 104,112, 
105, 125 115,117, 119,123, 124 
Delivery Networks 15, 48, 14,22,42, 43,50, 51, 83, 127 
Services at all layers 1,55 19,20,69, 70,87,108,109, 98, 106 
(XAAS) 118, 
Middleware 353, 12,17,32; 9, 11, 49, 54,68, 78, 88,92, 30,58, 114, 35, 36, 41, 
53,97, 101, 121, 94, 107, 96 44, 46, 95 
Percentage 28.35% 0.00% 54.33% 5.51% 18.81% 0.00% 
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Figure 3. Percentage of topics in the research category 


4.3. Major findings 

The systematic map on middleware, stacks, tools, delivery network and services at all layers on the 
cloud can be visualized in Figure 4. Two x-y scatter charts that contains bubble plots at the intersection of the 
topic were provided in the left quadrant, at the position where the topic and contribution facets traverse. The 

right quadrant is the map depicting the connection of the topic and research type facet also using a two x-y 

scatter plot with bubbles. The map made it easier to distinguish which classification had more importance. 

From Figure 4: 

a. It is obvious that there were more papers published in the metric area as it concerns tools. In fact, it is 
possible to identify clearly that more publications were created on tool, as it relates to the contribution 
facet. Tool, model, method and process had 18.10%, 13.79%, 6.03% and 8.62% respectively. 

b. Evaluation and solution research had the largest number of articles in terms of tools with 14.17% and 
26.77% respectively. In terms of experience research, middleware had the highest number of papers with 
4.72%. Also middleware had more articles in relation to philosophical research with 2.36%. There were 
no publications dealing with validation and opinion research based on the author’s investigations. 
Furthermore, in terms of studies carried out, there were no papers on delivery networks and XaaS. 

c. A most striking aspect of the map is that solution research has the highest frequencies of publications in 
relation to all aspects of the topics. This type of result shown on the systematic map should easily 
generate interest of researchers. The visual delivery of a systematic map has helped to summarize the 
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publication gaps providing results that can be used for further studies. This is a novel work and it is hoped 
that more papers will be published in this field to improve on what has been done in this research paper. 


Cloud Computing 
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Figure 4. Systematic map of cloud computing middleware and services 


The significance is that research experts at all levels could utilize this outcome for additional study. 
This study focused on six topics namely: stacks, tools, delivery network, services at all layers, middleware 
and orthogonal in relation to cloud computing middleware. In addition, six classes of study were considered 
either regarding tool, model, method, metric and process or in terms of evaluation, validation, solution, 
philosophical and opinion research. For future research these fields, among other things, are recommended. 
In this analysis, the essential lessons learnt is that the spectrum of research in any field is inexhaustibility. 
From the literature, the comparison with similar work is trivial because there has not been similar 
publications related to the title of this paper, hence making the contributions in this paper unique. It is 
expected that more upcoming researchers in the field of cloud computing will undertake more in-depth 
studies as a follow up to the paper. 


5. CONCLUSION 

Cloud computing is evolving very fast and so are the various challenges regarding the services being 
offered. Cloud users and providers alike are benefitting from cloud activities. This has inspired research 
efforts both within the industry and research institutions alike. The use of cloud services will require 
appropriate resources by prospective clients. Cloud providers must also strive to perform at an optimum 
level. This has led to lots of studies on cloud middleware and services. Several high impact studies were 
presented in this research. Notwithstanding, a shortage of publications in several aspects still exists. With the 
analysis carried out in the study, areas that need more work through the systematic map were highlighted. 
Contribution to the body of knowledge was realized by finding deficiencies in different aspects of the 
research. The research gaps established are useful for further studies, hence this forms the recommendation 
for this paper. This study can be strengthened by in-depth analysis of the topics extracted in this research 
when further studies are conducted. In summary, this study would enable researchers to identify important 
gaps in cloud middleware and services at all layers that were not addressed in past studies thus increasing 
research opportunities. 
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